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Abstract. Optimal control problems are usually addressed with the help of 
the famous Pontryagin Maximum Principle (PMP) which gives a generalization 
of the classical Euler-Lagrange and Weierstrass necessary optimality conditions 
of the calculus of variations. Success in applying the PMP permits to obtain 
candidates for a local minimum. In 1967 a direct method, which permits to 
obtain global minimizers directly, without using necessary conditions, was in- 
troduced by Leitmann. Leitmann's approach is connected, as showed by Carl- 
son in 2002, with "Caratheodory's royal road of the Calculus of variations" . 
Here we propose a related but different direct approach to problems of the cal- 
culus of variations and optimal control, which permit to obtain global minima 
directly, without recourse to needle variations and necessary conditions. Our 
method is inspired by the classical Noether's theorem and its recent extensions 
to optimal control. We make use of the variational symmetries of the problem, 
considering paramcter-invariance transformations and substituting the origi- 
nal problem by a parameter-family of optimal control problems. Parameters 
are then fixed in order to make the problem trivial, in some sense. Finally, by 
applying the inverse of the chosen invariance-transformation, we get the global 
minimizer for the original problem. The proposed method is illustrated, by 
solving concrete problems, and compared with Leitmann's approach. 



1. Introduction 

The main goal in optimal control is to find a global (or local) minimizer. One 
of the most important tools is given by the famous Pontryagin Maximum Princi- 
ple (PMP) which is a first order necessary optimality condition |T2]- The PMP 
provides a generalization of the classical Euler-Lagrange and Weierstrass necessary 
conditions of the calculus of variations and permits to obtain candidates for a local 
minimum. Further analysis is then needed, to effectively find the extremum. 

In 1967 a different approach, based on a coordinate transformation, was intro- 
duced by Leitmann 7. , allowing the direct global extremization of certain functional 
integrals of the calculus of variations, without the use of variational methods or field 
techniques || . The method is also valid for multiple integrals of the calculus of vari- 
ations f2J and is proved to be connected with "Caratheodory's royal road of the 
calculus of variations" pQ. Here we provide a new look to Leitmann's approach. 

We propose a different direct approach to certain problems of the calculus of vari- 
ations and optimal control, which permit to obtain global minima directly, without 
recourse to needle variations and necessary conditions. Differently from Leitmann, 
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our method is based on the variational symmetries of the problem: a notion intro- 
duced by Emmy Noether in the classical context of the calculus variations ^2 and 
then extended to the more general context of optimal control (141 . Our method 
proceeds in three steps: (i) we consider parameter-invariance transformations of the 
problem, generalizing the original problem to an equivalent one; (ii) parameters are 
then fixed in order to make the generalized problem trivial in some sense; (iii) fi- 
nally, the desired global minimizer is obtained by applying the inverse of the chosen 
invariance-transformation and imposing the fulfilment of the boundary conditions. 

The paper is organized as follows. In fJ2Jwe formulate the optimal control prob- 
lem, providing all the necessary background. In S|2l we recall Leitmann's approach 
and apply it to a simple problem of the calculus of variations. The same problem 
is then solved in for comparison and motivational purposes, by our direct op- 
timization method. After summarizing the main ideas and steps of the proposed 
method, we end Slby considering the minimum fuel rendezvous of a constant-power 
rocket. Finally, some conclusions are presented in Sj5j 

2. Preliminaries 

Without loss of generality, we consider the problem of optimal control in La- 
grange form: to minimize an integral functional 

(1) I[x(')M-)] = I L(t,x(t),u(t))dt 

J a 

subject to a control system 

(2) x(t) = (p (t, x(t),u(t)) a.e. on [a, b], 

together with appropriate boundary conditions x (a) — a, x(b) — /3. The Lagrangian 
L(-, ■, ■) is a real function, assumed to be continuously differentiable in [a, b] x K n x 
M. m ; t £ K is the independent variable; x : [a, b] — ► M. n the vector of state variables; 
u : [a, b] — > f2 C K m the vector of controls, assumed to be a piecewise continuous 
function; and ip : [a,b] x M. n x M. m — ► R" the velocity vector, assumed to be a 
continuously differentiable vector function. In the particular case (p(t, x,u) = u one 
gets the fundamental problem of the calculus of variations. 

The essential concept we are going to use is that of equivalence between two 
problems of optimal control. In Caratheodory's terminology two problems of the 
calculus of variations are said to be equivalent when the respective Lagrangians 
differ by a total derivative |Tj . The importance of this equivalence concept owes to 
the fact that it implies the Euler-Lagrange equations to be identical for both prob- 
lems. In 1 15] the following consequence is explored: two Caratheodory- equivalent 
problems have the same conservation laws. It turns out, has proved by E. Noether 
|121 ITB| , that conservation laws are a consequence of the existence of invariance- 
transformations (variational symmetries). The method we propose here is based on 
the following trivial remark: the invariance-transformations define a direct relation 
between admissible state-control pairs, being straightforward, from the transforma- 
tions which define the equivalence, to obtain a solution for any of the equivalent 
problems known the solution for one of them. The variational symmetries may be 
found with the help of a computer algebra system [S] and, roughly speaking, a given 
problem is solved if it admits an enough rich set of variational symmetries 

and there exists an equivalent formulation of the problem with a trivial solution. 
This will be illustrated in Now we recall the notion of invariance (variational 
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symmetry) of an optimal control problem with respect to a s-parameter family of 
transformations. 

Definition 2.1 (cf. Let h s (-, •, •) be a one-parameter family of C 1 map- 

pings satisfying: 

h s : [a, b] x M" x il — >lxl"x R m , 
h s (t,x,u) — (t s (t, x, u), x s (t, x, u), u s (t, x, u)) , 
h°(t, x, u) = (t, x, u) , V(t, x, u) <E [a, i]xl"xO. 
If there exists a function x, u) <E C 1 ([a, 6], R™, O; R) such that 

(3) L o h s (t, x{t),u(t))-t s (t, a:(t), u(t)) = L (t, u(t)) + (t, u(t)) 
and 

(4) ^-x s (t, x(t),u(t)) = ipoh s (t, a:(t), u(i)) ^-t s (t, a;(t), u(t)) 
at at 

for all admissible pairs (x(-), u(-)), then the optimal control problem is said 

to be invariant under the transformations h s (t,x 7 u) up to <& s (t, x, u). 

A parameter-transformation h s (t,x,u) satisfying all the conditions of Defini- 
tion l2.1l is said to be a variational symmetry of the optimal control problem ©-(01. 
These invariance-transformations are the starting point to our direct optimization 
method 31 Next, we review, comment and illustrate Leitmann's approach. 

3. Remarks on Leitmann's direct optimization method 

G. Leitmann has proposed in 1967 a direct optimization method for a certain 
class of scalar problems of the calculus of variations . Leitmann's method is based 
on the use of transformations that satisfy a certain functional identity and permit to 
obtain, in some cases, absolute extremals directly, without using variational meth- 
ods. Since the pioneering work Leitmann has worked on several generalizations 
of his method, extending the class of problems to which the method may be applied: 
to problems of the calculus of variations where the trajectory is vector- valued, i.e. 
x(t) 6 R™, and to problems with side differential conditions that arise in optimal 
control |3; by allowing constraints in the form of differential equations and by 
considering infinite-horizon problems |1U| . More recently, Carlson and Leitmann 
extended the method to free problems of the calculus of variations with multiple 
integrals [H]. In this section we synthesize Leitmann's method El E3] ■ Then, 
we apply it to solve a simple problem of the calculus of variations which is used in 
21 to motivate our method. 

3.1. Leitmann's main results. Consider the fundamental problem of the calculus 
of variations: 

(5) I[x{-)]= ( L(t,x(t),x(t))dt — >min, 

J a 

where x(t) = dx J^ , [a, b] is a given fixed interval, the Lagrangian L(-, •, •) is a real 
continuously differentiable function in [a, b) xExR, the admissible functions x(-) 
belong to PC 1 and must satisfy the boundary conditions 

(6) xla) = a , x(b) = f3 . 
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Theorem 3.1. Let x = z{t,x) be a transformation having an unique inverse x — 
z(t,x) fort € [a, b], such that there is a one-to-one correspondence 

x(t) x(t) , 

for all functions x(-) : [a, b) — ► R in the class PC 1 satisfying (jBJ) and all functions 
i(-) : [a, b] — * R in the class PC 1 satisfying 

(7) x(a) = z(a, a) , x{b) = zip, (3) . 

If the transformation x — z{t 1 x) is such that there exists a function G : [a, b] x M — > 
R smc/i i/iai </ie functional identity 

dG 

(8) L (t, x(t),x(t)) - L (t, 5(t), 5(t)) = — (t, i(t)) 

holds, then if x*(-) yields the extremum of /[•] wzi/i satisfying l(7)l. = 

yields the extremum of /[•] forx*(-) satisfying (j^J. 

Remark 3.1. To the best of our knowledge, no one has interpreted JBJ before as being 
Noether's invariance condition © in the particular case where no transformation 
of time is considered, i.e. t s — t. Instead of ©, the method we propose here is 
based on the more rich set of identities ©-0- 

There is a one-to-one correspondence between the minimizers of problem JSJ)- 
(jHJ and the minimizers of the integral functional = L (t,x(t),x(t)^ dt in 

the class of functions x(-) E PC 1 satisfying the boundary conditions (0). More- 
over, the transformation x = z(t,x) and its inverse x — z(t,x) give us the desired 
correspondence. 

Corollary 3.2. For the validity of Theorem VS . IV the Lagrangian -, ■), together 
with the transformation x = z{t,x), must be such that the left-hand side of the 
functional identity (JHJ is linear with respect to x(t). 

The main difficulty in applying Leitmann's method (Theorem 13.111 resides in 
finding the admissible transformations x — z{t,x). Leitmann has restricted himself 
to two situations for which it is easy to find the admissible transformations: (i) 
Corollary 13.21 is trivially satisfied if L(-, •, •) is linear in its third argument; (ii) it 
can also be readily satisfied for L{-, •, •) quadratic in its third argument, i.e. for 
L(-, ■, ■) of the form 

(9) L(t,x,p) = a(t)p 2 + b(t, x)p + c(t, x) , 
with a(t) ^ for t 6 [a, b]. 

Corollary 3.3. For a Lagrangian of type the class of admissible transformations 
that satisfy Corollarv \S. e A is of the form x — z(t, x) — ±J + f(t). 

Remark 3.2. Using our Ii.emark l3.ll we can benefit of a well-developed theory ^fllHlE] 
on how to find Noether's invariance transformations, without the need to restrict 
ourselves to Lagrangians which are linear or quadratic in the velocity. 1 Therefore, 
the method we propose is applicable to a more wide class of optimization problems. 



A computer algebra package to compute variational symmetries, by Paulo D. F. 
Gouvcia and Dclfim F. M. Torres, is available from the Maple Application Center: 
http: //www.maplesof t . com/applications/app_center_view . aspx?AID=1983 
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3.2. An example. Let us apply Leitmann's method to the following simple prob- 
lem of optimal control (a < 6): 

,6 

%(•)] = / ( U M) 2 dt — > min > 

(10) i(t) = «(t), 

x(a) = a , a;(6) = /3 . 

This is a problem with ip = u, so we can write l)l(Jfl as a problem of 

the calculus of variations: 
rb 

I[ x (')] — / OK*)) ^ — >min, a;(a) = Q!, x(b) = . 

J a 

The Lagrangian L(t,x,p) — p 2 is of type ©, thus, by Corollary 13.31 the class of 
admissible transformations of Theorem 13. II has the form x = z(t,x) = ±x + f(t), 
where f(t) is some differentiable function. We consider, without loss of generality, 
the transformation x — z(t. x) = x + f(t). Then, 

L (t, f(t) + x, f'(t) +p)-L (t, x,p") = (f(t)f + 2f(t)p , 
and from the functional identity © we get 



On the other hand, 



f)G BG 

— (t,x) = (f(t)f , ^(i,5) = 2/'(t). 



d 2 G , d 2 G , 



and we conclude that 

(11) 2/"(t)=0, 
that is, 

(12) /(*) = <* + erf, 

with ci and C2 constants. We now determine function G(t, x). Substituting l|12|) 
into ^(t,x) — 2f'(t) it follows that ^-(t,x) = 2c2, and integrating with respect 
to x we arrive to 

G(t, x)= / (2c 2 )dx = 2c 2 x + h(t) , 



where h(t) is still to be determined. For that, we differentiate the last expression 
with respect to t and compare the result with ^jf(t, x): 

^ (2c 2 x + h(t)) = h'(t) , 
ot 

and since ^f(t,x) = (C2) 2 we must have 

h'(t) = (c 2 ) 2 ^h(t) = (c 2 ) 2 t + c 3 , 

where C3 is an arbitrary constant. Therefore, G(t, x) = 2c 2 x + {c 2 ) 2 t + C3. We have 
all the necessary ingredients to apply Theorem l3.ll We consider the trivial problem 

f b ■ 2 

I[x(-)]= / (x(t)) dt — >min, x(a) = , x(b)=Q, 

J a 

which admits the global minimizer x*(t) = (the original problem (|lf)|> is trivial 
when a = f}\ we are interested to solve (tT7)|) in the case a (3). To obtain the 
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solution of problem (fTTTft we just need to choose c\ and C2 in (fT^|l in such a way 
f(a) = a and f(b) = (3, i.e. 

f f(a) =a fci + c 2 a = a [c x = 



-b 

8 

a — b 

The global minimizer for problem I|1U|) is given by x*(t) — x*(t) + f(t) = + ci + C2t: 



f{b)=P \ Cl +c 2 b = P lc 2 -^ 



, iq \ (3a -ba a - (3 
(13) x (t) = — + -t . 

a — b a — b 

We remark that 11KSII satisfies (II 1 1) . and that (|ll|l is nothing more than the 
Euler-Lagrange equation of l|10|) . However, the Euler-Lagrange equation only gives 
a candidate for local minimizer, i.e. we are not sure if the candidate is indeed a local 
minimizer. Leitmann's method has given much more: l|13|l is the global minimizer 
of llOJI . Next section gives an alternative direct optimization method, which we 
claim to be more broad in application. 



4. A NEW DIRECT OPTIMIZATION METHOD 

Our direct optimization method is of simple comprehension and is applicable to 
a wider class of optimal control problems. We first show how it can be applied to 
problem l(TT)|) . 

4.1. Motivational example. The initial step of our method is the determina- 
tion of the parametric transformations under which the problem is invariant (see 
Definition 12. l|l . In respect to this, the techniques found in 0E! are useful. 

Proposition 4.1. |141 Ex. 1] Problem (|10|l is invariant up to $ s (t,x) — s 2 t + 2sx, 
in the sense of Definition \2.1\ under the s-parameter transformations (s € 

(14) t s =t, x s =x + st, u s = u + s. 

Proof. We begin by showing J2J: 



(u s (t)) 2 dt= / (u(t) + sYdt= / (u 2 {t) + .s 2 + 2su(t))dt 



(15) 



f f f d 

' u 2 (t)dt+ (s 2 + 2su{t)) dt = I + — (s 2 t + 2sx(t)) 

a J a Ja dt 

/ + $ s (6, (3) -$ s (a,a). 



dt 



We remark that the minimizer of /[•] coincide with the one of /[•]: $ s (a, a) and 
$ s (6, (3) are constants and adding a constant in the functional does not change the 
minimizer. It remains to prove the control invariance condition Q: 

(16) j t (x s (t)) = j t (x(t) + st) = x(t) + s = u(t) +s = u s (t) . 

Equalities H15(l and 116|l prove that problem l|10(l is invariant under the one-parameter 
transformations l|14|l up to the gauge term $ s . □ 
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Using the invariance transformations l(14j) we generalize problem (jlt)|) to a param- 
eter family of problems which include the original problem for s = 0: we substitute 
x(-) and u(-) in IjlUfl respectively by x s (-) and u s (-), obtaining 

,6 

I S [u S (-)}= (u s (t)fdt — -4 min, 

^ 17 ^ x s {t) =u s {t), 

x s (a)=a + sa, x s (b) = (3 + sb , seM. 

Problem l|10|l is nontrivial for a ^ 3, but the crucial point is that there exists 
always a problem in the parameter family of problems l(17j) . i.e. there exists always 
a specific value of s, which only depend on the concrete values of a, 3, a and 
&, admitting the trivial global minimizer u s (t) = V t 6 [a, 6]. The invariance 
properties asserted by Proposition 14.11 give the general solution to our original 
problem (|10|) from the trivial solution of this s-chosen problem. 

Proposition 4.2. Function (|13|1 is a global minimizer of problem <|10[l . 

Proof. It is clear that I s > and that I s = if u s (t) = 0. From the control system 
x s (t) = u s (t), u s (t) = implies that x s (a) = x s (b): 

n i (3 - a 

a + sa = p + so4>s= . 

a — b 

Hence, the global minimizing trajectory of problem l|17|l for s = is given by 

... „, , 8a — ab 

x s (t) =a + sa<$ x s {t) = — . 

a — b 

We solve (|1UII using the inverse functions of the variational symmetries (11411 : 



a- 13 
a—b 

x(t)=x°(t)~ S t " \ X {t) = ^-^ t . 



u(t)=u s (t)-s J«(t) 



-b a — b 

We have just found the global minimizer (|13|l of problem IjlUI) . □ 

4.2. The method. As just illustrated, our direct optimization method permits 
to find global extremizers (minimizers or maximizers) of sufficiently rich invariant 
optimal control problems. The method consists of the following four steps: 

(1) Determine parameter invariant transformations t s , xf, and itj, i = 1, . . . , n, 
j = l,...,m, under which the problem is invariant (cf. Definition 12.1(1 . 
The results in [SJE! are useful. 

(2) Applying the parameter transformations found in the previous step, write 
the generalized problem together with the generalized boundary conditions, 
i.e. substitute Xi(-) and %(•) respectively by xf (■) and w^(-), i = 1, . . . ,n 
and j = 1, ... ,m. 

(3) Analyze the generalized problem and determine a specific value for the 
parameters for which it is easy to find a global optimal solution. 

(4) Define the inverse of the transformations t s , x s , and u s , for the particular 
choice of parameters s fixed on step (3), and obtain a global solution to the 
initial problem. 

We shall now apply our simple method to the minimum fuel rendezvous problem 
of a constant-power rocket. 
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4.3. An application. Let us consider the problem of minimizing the amount of 
fuel consumed by a rocket operating at constant propulsive power. This is a classical 
problem of optimal control, "solved" by the Pontryagin Maximum Principle in most 
books (see e.g. (HE])- We assume the following situation: (i) a positive prescribed 
transfer time r = t\ — to is given; (ii) at the end (at time t\) the rocket car is to be 
at the origin with zero-velocity; (iii) the rocket is initially on the negative axis (at 
a given position —a, a > 0). Thus, we have: 

cti 

u 2 {t)dt — > min , t\ — to = r , 



(18) (xi(t)=x 2 (t), 

\x 2 (t) = u(t), 

xi(t ) = -a , xi(ti) = , x 2 (ti) = , 

where t is the time variable, x\ the position, x 2 the velocity, and u is the acceleration 
due to the thrust. We are assuming that the thrust-acceleration is not constrained, 
i.e. \u(t)\ < oo, and that r > and a > are given. The thrust-acceleration 
program that results in the minimum fuel consumption can also be obtained by 
Leitmann's method (cf. 9, § 9]) but the analysis is enough-complex: it is not easy 
to guess functions f\{t) and f 2 (t) of Corollary associated respectively with 
x\{t) and x 2 (t). Here we show that there exists a simple way to obtain a global 
minimizer to problem JT5J. 



Proposition 4.3. A global minimizer of problem Ijl8|) is given by 

2a (to \ 2a f t, 
~ { 2t 



a n zci io \ ^a / in \ 
Xl (t) = - - 2 t 2 + — ( -£ + 1 ) t — ( JL + 1 ) to a , 



/, n \ . . 2a 2a ( to 

(19) x 2 (t = — + 

T Z T \T 

2a 

u(t)=-—. 

Proof. We follow the four-step method of H4.2I 

(1) Problem (|18[) is invariant under the parameter transformations (s G R) 

s 2 

(20) t s = t, aff(t) = jci(t) + yi 2 , x s 2 {t) = x 2 (t) +s 2 t, u s (t) = u(t) + s 2 . 
up to <J> S (t,x 2 ) = s 4 t + 2s 2 x 2 : the functional is invariant, 

(u s (t)) 2 dt= I' (u(t) + s 2 ) 2 = / 1 (u 2 (<) + s 4 + 2s 2 u{t)) dt 



it, 



u 2 {t)dt + (s 4 + 2s 2 u{t)) dt 



t 

u 2 (t)dt+ — (s 4 t + 2s 2 x 2 (t)) dt; 
J t "-t 

as well as the control system, 

[ft (*!(*)) = I + T i2 ) = *(*) + s2< = + * 2i = ^(*) : 
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(2) The generalized problem takes the following form: 

rti 

= / (u s {t)) 2 dt > mh 



(21) 



r±!(t)=s2(t), 

\±3(t) = u'(t) , 



For s = problem (J2TJ reduces to lfT%|) . 

(3) I s > V and I s = if u 3 (t) = 0. From the control system we have 
for u s (t) = that x 2 (t) = ci, and x\{t) — c\t + c 2 , where c\ and c 2 are constants. 
From the generalized boundary condition x^iti) — s 2 ti, it follows that c\ — s 2 t 1 . 
Then, x 2 (t) = s 2 ti, x{(t) = s 2 tit + c 2 . Using the boundary conditions for xf (•) we 

arrive to c 2 = — -y 1 an d s 2 — fr- Therefore, a global minimizer to problem l|21|) 

with s = is given by 

c / s 2a at? „ . , 2a „, . 

x{(t ) = _i 1 t-_A, a:|(* = u s t =0, teto.ti. 

(4) The global solution to problem l|18(l is obtained using the inverses of trans- 
formations pn)l for s 2 = 



2a at 2 
2" ~ T 2 "^" ~ r 2 ' 



(22) X2 (t )=x s( t) - s H=^ tl -^t. 



T 2 1 T 2 ' 

u(t)=u s (t)-s 2 = ~. 



It is a simple exercise to see that 11191 and (|22f) are equivalent. □ 



5. Conclusions 

In the calculus of variations, as well as in the more general setting of optimal con- 
trol, the problem of minimizing an integral functional is the main issue, in general 
a difficult one. The standard way to attack such problems relies on necessary opti- 
mally conditions, which give candidates for a local minimum. A direct method for 
addressing some problems of the calculus of variations which are linear or quadratic 
in velocity (control) was introduced by Leitmann and further improved by Carlson, 
providing global minimizers directly, without using necessary conditions. Here we 
propose a different, simpler, and more wide applicable direct method for problems 
of optimal control: (i) different because instead of using transformations which 
keep the problem invariant in Caratheodory's sense, as in the method of Leitmann- 
Carlson, our method is based on transformations which keep the problems invariant 
in Noether's sense; (ii) simpler in finding the admissible transformations; (iii) more 
general because it easily covers Lagrangians which are not linear or quadratic in 
the control variables. 
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